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< METHOD FOR EFFICIENT RETRANSMISSION TIMEOUT ESTIMATION IN 

NACK-BASED PROTOCOLS 



CROSS REFERENCE TO RELATED APPLICATION 

5 

This application claims the benefit of U.S. Provisional Application Serial No. 
60/262,591 filed January 18, 2001, the teachings of which are incorporated herein by reference. 



BACKGROUND OF THE INVENTION 



1. Field of invention 

The present invention relates to retransmission timeout (RTO) estimators, and 
particularly, to a system and method for estimating RTO in the NACK-based real-time 
streaming applications that support multiple re-transmission of the same packet. 

15 

2. Description of the Invention 

In general, there are two types of Internet transport protocols that support lost packet 
recovery in a data communication network. The first approach is ACK-based as set forth under 
the transmission control protocol (TCP), which involves the receiver sending a positive 
20 acknowledgment (ACK) in response to each received packet. The second approach is NACK- 
based under a user datagram protocol(UDP), which involves the receiver sending a negative 
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* acknowledgment (NACK) in response to each lost packet. 

Referring to FIG. 1(a), TCP utilizes a system of positive acknowledgments (ACK) for 
data arriving to the receiving endpoint as the mechanism for error recovery. This system 
5 operates under the principle that only unacknowledged frames should be retransmitted. To 
ensure that the packet is safely received by the sending source, TCP uses a retransmission 
timeout (RTO) mechanism by managing a retransmission timer for each connection. That is, 
TCP sets the retransmission timer and tacks an RTO value and a round trip time (RTT) for the 
connection. The RTT is the time elapsed between the start of transmission of a TCP-type data 
10 segment and the receipt of an acknowledgment of that segment. If an acknowledgment is not 
received by the time the RTOi expires, TCP retransmits the data again within next the RT0 2 . 

In contrast, UDP utilizes a system of negative acknowledgments (NACK) by 
forwarding a NACK packet to the sending source in response to the lost frame for 
15 retransmission, as shown in FIG. 1(b). In addition, the NACK packet can be lost along the 
path from the receiver to the sender. To this end, UDP utilizes a retransmission timeout 
mechanism that is similar to the TCP for retransmission connection. 

It is important that the estimation of an RTO value is performed accurately. Normally, 
20 the RTO estimation is performed by predicting the next value of the RTT based on the previous 
samples of the RTTs. If the RTO is overestimated, it leads to lower throughput performance 
in TCP and may cause an increased number of under-flow events in real time application. Yet, 
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if the RTO is underestimated, the protocol generates a large number of duplicate packets that 
cause serious network congestion as more of unnecessary packets are retransmitted. 

A background of current standards, which is based on TCP's retransmission timeout 
estimator, is described hereinafter. The standard consists of two algorithms described below. 
The first algorithm, smoothed RTT estimator (SRTT), is based on an exponential- weighed 
moving average (EWMA) of the past RTT samples: 



where RTT, represents the z'-th sample of the round-trip delay produced at time U and 
□ (set by default to 1/8) represents a smoothing factor that can be varied to give more or 
less weight to the history of RTT samples. 

The second algorithm, smoothed RTT variance estimator (SVAR), computes an 
approximation to the RTT variance using similar EWMA formulas to the ones described 



where fi (set by default to l A) represents an EWMA smoothing factor and VAR t 
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above: 
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represents the absolute deviation of the f-th RTT sample from the smoothed average: VAR, = 
| SRTT,-i - RTT,\. 

Finally, the RTO is determined by multiplying the smoothed variance by four and 
5 adding it to the smoothed round-trip delay: 

RTO(t) = SRTTi + 4 • SVAR, , (3) 
10 where t represents the time at which the RTO is computed, and i = max: t t < t. 

In real-time streaming applications, e.g., multimedia applications, NACK-based 
operation is preferred due to a lower overhead along the path from the receiver to the sender 
and potentially faster recovery of lost packets. However, the RTO estimator, as described in 

1 5 the preceding paragraphs, is typically suitable only for the ACK-based applications and is not 
applicable to NACK-based protocols by design. It produces an extended number of duplicate 
packets and causes unnecessary delays in the generation of the subsequent NACK requests in 
real-time streaming applications due to poor prediction of the next RTT value. In addition, 
NACK-based protocols do not have a common RTO estimation scheme that works well in 

20 heterogeneous Internet conditions. Despite these drawbacks, many NACK-based protocols are 
still utilizing the existing RTO estimating protocol, which is borrowed from TCP. 



As described above, an RTO estimator is described by two parameters - the number of 
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duplicate packets and the amount of unnecessary time out waiting. However, these two 
parameters cannot be minimized at the same time as they represent a basic trade-off of the 
estimator (i.e., decreasing one parameter will increase the other). Since TCP's RTO estimator 
proves to be inapplicable in NACK-based protocol, there is a need for such protocols to employ 
5 the class of optimal RTO estimators, which are described in this patent disclosure. 

SUMMARY OF THE INVENTION 

The present invention is directed to a method and system for estimating retransmission 
1 0 timeout (RTO) in a real-time streaming applications over the Internet between a server and a 
client. 

The present invention provides a method of estimating retransmission timeout (RTOj) 
used in a communication system to support multiple retransmission and the method includes 

1 5 the steps of: transmitting a plurality of data packets from a server to a client; transmitting a 
negative acknowledgment (NACK) packet for retransmission by the client if one of the data 
packets is missing; computing a round-trip delay (RTT,) corresponding to a latency between 
sending the NACK packet to the server and receiving the corresponding retransmission of the 
missing packet from the server; calculating a plurality samples of delay (□_,) between the 

20 reception adjacent packets of the plurality of data packets by the client; determining a smoothed 
inter-packet delay variance (SVARUj) based on the calculated delay samples; and, computing 
the RTOj based on the determined RTT, and the determined smoothed inter-packet delay 
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variance. 

The present invention provides a system of managing transmission of a plurality of data 
packets over a communications link between a server system and a client system and includes: 

5 a means for receiving the data packets in the form of frame comprised of packets; a means for 
determining whether any frame packets were lost during transmission; a means for requesting 
that any lost frame packets be retransmitted; a means for determining a round-trip delay (RTT,) 
corresponding to a latency between requesting retransmission of the lost frame to the server and 
receiving the corresponding retransmission of the lost frame from the server; a means for 

1 0 determining inter-burst packet delay variations; and, a means for determining a retransmission 
timeout (RTOj) based on the determined RTT and the determined inter-burst delay variations. 

These and other advantages will become apparent to those skilled in this art upon 
reading the following detailed description in conjunction with the accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
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FIG. 1 (a) illustrates representative data flows in the TCP communication environment; 

FIG. 1 (b) illustrates representative data flows in the UDP communication environment; 

FIG. 2 illustrates a block diagram of a system according to the present invention; 

FIG. 3 illustrates the various layers that make up the Transmission Control 
Protocol/Internet Protocol (TCP/IP); 

FIG. 4(a) illustrates the format of a user datagram protocol (UDP) packet at the server 
end in accordance with the present invention; 

FIG. 4(b) illustrates the format of a user datagram protocol (UDP) packet at the client 
end in accordance with the present invention; 

FIG. 5 illustrates a time chart depicting the jitter-based retransmission timeout (RTO) 
estimation according to the present invention; and, 

FIG. 6 is a flow chart illustrating the operation of the retransmission timeout (RTO) 
estimator according to the present invention. 
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In the following description, for purposes of explanation rather than limitation, specific 
details are set forth such as the particular architecture, interfaces, techniques, etc., in order to 
provide a thorough understanding of the present invention. However, it will be apparent to 
5 those skilled in the art that the present invention may be practiced in other embodiments which 
depart from these specific details. Moreover, for the purpose of clarity, detailed descriptions 
of well-known devices, circuits, and methods are omitted so as not to obscure the description 
of the present invention with unnecessary detail. 

„ 1 0 According to an embodiment of the present invention, a mechanism for controlling the 

retransmission of data packets in a digital communication environment is provided. Referring 
to FIG. 2, a system 10 which uses the invention comprises a first system 12, such as a server 
device, a second system 14, such as a client device, which is in communication with each other 
via access link of the network 16. Preferably, the inventive retransmission mechanism is 

15 placed at the client system. As shown in FIG. 2, the present invention can be practiced in a 
client-server environment, but the client-server environment is not essential. 

In this invention, the server system 12 sends at least one source packet or sends packets 
in bursts to the client system 14 over the network. However, in the event that the source packet 
20 or burst packets from the server system 12 to the client system 14 is transmitted in error or lost, 
the client system 14 transmits a negative acknowledgment (NACK) packet to the server system 
12 for retransmission. Then, the client system 14 establishes a limit on the timer period and 
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retransmits the NACK packet to the server system 12 if the requested packet or burst packets 
are not received within a specified time period. 

It should be noted that many real-time streaming servers are implemented to transmit 
5 their data in burst packets instead of sending one packet every specified period. This type of 
burst transmission typically reduces the overhead associated with frequent switching between 
processors. In addition, the bursty packet transmission is more adapted to handle varying 
packet sizes and allows more simultaneous streams per server. However, it is not required. 

1 0 According to an embodiment of the present invention, packets that are received in error 

or lost are notified back to the server system 12 by the client system 14 via a NACK packet. 
Here, a user datagram protocol (UDP) is utilized. FIG. 3 depicts the various layers that make 
up the Transmission Control Protocol/Internet Protocol (TCP/IP) suite. Basically, TCP 
provides end-to-end transport services across multiple heterogeneous networks and the delivery 
~'15 of sequenced packets of information across the Internet. UDP is a connection-less transport 
protocol designed to operate using the service of IP and provides minimal error detection for 
streams of information. At the network level, IP provides a "datagram" delivery service. 

The format of a UDP packet according to the present invention is shown in FIG. 4(a) 
20 and FIG. 4(b). Each packet in a real-time application carries a burst identifier, which allows the 
receiver to distinguish packets from different bursts. Referring to FIG. 1 (b), a NACK packet 
is send to the server system if the source packet therefrom is lost along the transmission path. 

9 
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« The loss of packets is detected by system 14 through gaps in sequence numbers. For each 
NACK-packet transmitted, the inventive protocol maintains a timer. If the timer expires, the 
NACK-packet is retransmitted. To avoid the confusion of which retransmission of the same 
packet actually returned to the client system, the header of each NACK packet contains an extra 
5 field specifying the retransmission sequence count in addition to the lost packet sequence 
number, as shown in FIG. 4(b). Thus, the client system can pair each retransmitted packet with 
the exact time when the corresponding NACK packet was sent out and properly measure the 
RTT. 

"ii 0 As the source packets are being transmitted over a path with unpredictable delay, the 

m present invention continuously adjusts the threshold at which the retransmit timer expires. That 
=p is, the transmission path changes during the lifetime of the connection, and the state of the 
^ routers (or switches) also changes as more or less traffic is being carried by the network. 
j*1 Accordingly, the present invention incorporates a new round-trip estimation mechanism that 
?|5 can be used to determine more accurate timing in retransmitting the NACK-packet. Unlike the 

prior art, estimate of the delay jitters between arriving packets is used in the present invention 

as the basis to set the retransmit timer threshold. 

The following description is a detailed description of specific algorithms of a 
20 retransmission mechanism according to the present invention. In real time multimedia 
applications, the server system 12 typically sends packets in bursts for the duration of time, Dj,. 
Here, Db is based on the streaming rate and the average packet size. Referring to FIG. 5, for 
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each burst j, the last packet of the burst arrives to the client at time t } , and the first packet 
of the burst arrived at time t } f,rst . Thus, the inter-burst delay for burst j can be defined as below 
equation 4: 

=t/ rsl -t k last , (4) 

where burst k represents the last burst received before burst j (unless there is packet 
loss, k=j-l). For each burst j, using EWMA formulas similar to those in TCP, the smoothed 
inter-burst delay SOj and smoothed inter-burst delay variance SVARDj are computed as defined 
in the following equations (5) and (6): 



and 



I (1 - a,) *so fl + Di »□,,;> 1 



(5) 



SVARO,= < (6) 
J 1 (1 - □ ,) * SVARUj., + □ , * VARUjJ > 
1, 

where □ i and D\ represent exponential weights and VARDj represents the absolute 
deviation of from its smoothed version SOj-i . Here, SQj is typically proportional to the 
burst duration Db, and thus it cannot be used the same way in real-time applications with a 
different burst duration. However, the smoothed variance SVAR □, is fairly independent of the 
burst duration and reflects the variation in the amount of cross traffic in the router queues along 
the path from the server to the client. 
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With the transmission delay and its delay variation from equation (6), if 7} is the time 
when the client produced the j-th sample of the inter-burst delay (ideally, 7} equals t/ rst ) and 
h is the time when the client computed the z'-th RTT sample RTT, (explained later), then the 
5 effective jitter-based RTO according to the present invention at time t is: 

RTOj (/) = «* RTT t +m* SVAR U p (7) 

where / = max : t,<t and j = max :7} < t. 

Furthermore, in the event that there is a longer delay between the measurements of the 
RTT, a slight modification to equation (7) can be provided to better approximate the RTO. 
This better estimator, called RTO JD , can be created by incorporating the duration between the 
time of the last RTT sample (i.e., tj) and the time where the RTO is being estimated (i.e., f) into 
the RTOj estimator: 

RTOj D (t) = (n + k(t- t,j) * RTT, + m * SVAR □„ (8) 

where / = max :t,<t, j- max :T } <t, and time units for t and tj are seconds. 

20 It should be noted that both jitter-based RTO estimators, as described in the preceding 

paragraphs, achieve optimality when □ i = 0.5, □ i = 0.25, k = 0.5, and m = 4.2792 * » - 2.6646. 

12 
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The remaining free parameter n can be used to vary the desired number of duplicate packets 
on a per-application basis: higher values of n correspond to fewer duplicate packets. The 
recommended values of n are between 1 and 4. It should be noted that frequent delay jitter 
samples prove to be very helpful in fine tuning NACK-based RTO estimation and can be used 
as a good predictor of the changes in the future RTTs. 

It should be noted that the estimator of the present invention for determining the 
retransmission timeout (RTO) can be realized using a processor, microcomputer, an 
application-specific integrated circuit (ASIC), a programmable device, or any other device 
designed and operated to provide the functionality described herein. A flow chart of a key 
operation of the estimator is shown in FIG. 6, as hereinafter explained. 

Referring to FIG. 6, each packet is plugged into an estimator algorithm that tracks two 
quantities: the round trip delay estimate (RTT) and the variance in inter-burst delay jitter 
(SVARD). In step 600, each packet is received at the client system. If there were missing 
packets, a NACK packet for each packet is sent to the service system in step 610. In such a 
case, the transmission time of each NACK packet requesting a retransmission of packet (i), 
nacki, is recorded, then the timer to transmit the subsequent NACK packet is set in step 610. 
Meanwhile, if retransmission of the data packet is reliably completed from the server to the 
client system, the round trip delay (RTT) is computed in step 620. 

According to the embodiment of the present invention, the receiver in a real-time 
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session must periodically measure the round-trip delay. The client system obtains the RTT 
measurements by utilizing packet loss to measure the round-trip delay - each successfully 
recovered packet provided a sample of the RTT. That is, the RTT is the duration between 
sending a NACK and receiving the corresponding retransmission. Alternatively, the RTT is 
5 measured by the client by obtaining additional samples of the round-trip delay in cases when 
network packet loss was too low. To this end, the client periodically transmits simulated 
retransmission requests to the server if packet loss falls below a certain threshold. In response 
to these simulated NACKs, the server sends the needed packets to the client. 

1 0 In step 630, it is determined whether the received packet belongs to the same burst as 

the previously received packet. If it is different, in step 640, the inter-burst delay is computed, 
as described in equation 4. The inter-burst delay is measured between the receipt of the first 
packet of the burst and the last packet of the previous burst at the client side. To distinguish 
between different bursts and utilize equation (4), the system records the parameters of the last 

:I5 received packet in step 650. 

Next, the inter-burst delay samples are averaged into a smoothed inter-burst delay (SD) 
estimate, which is then used to control the retransmissions time-out parameter (RTO). Using 
step 660, for each burst, smoothed inter-burst delay and smoothed inter-burst delay variance 
20 are calculated in step 670 and 680, respectively. Step 670 is performed to update the smoothed 
inter-burst delay value, which is used for determining the variance in the subsequent calculation 
process. These steps are executed according to equations 5 and 6. Hence, as each new packets 
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are added, the mean and variance change. 

Finally, the retransmit timeout mechanism (RTO), which is a timeout to prompt 
retransmission of unrecovered data, is calculated in step 690. The latest RTT sample has the 
5 most relevance to the value of the future round-trip delay due to the large spacing between RTT 
samples in NACK-based applications. Upon expiration of the timer for packet (i), the client 
system 14 retransmits the NACK packet, nack )? and sets the timer for another RTO time unit 
for packet (i). The recommended values of n are between 0 and 4, and the value of m is set to: 
m = A. 2192 * n - 2.6646. 

10 

In summary, the present invention provides a new RTO estimation mechanism, which 
achieves significant performance improvements (i.e., fewer duplicate packets and less 
unnecessary waiting time) over the existing RTO estimation algorithms when employed in 
NACK-based protocols. Having thus described a preferred embodiment for managing 

15 retransmission over a digital communications link, it should be apparent to those skilled in the 
art that certain advantages of the system have been achieved. The foregoing is to be 
constructed as only being an illustrative embodiment of this invention. Thus, persons skilled 
in the art can easily conceive of alternative arrangements providing a functionality similar to 
this embodiment without any deviation from the fundamental principles or the scope of this 

20 invention. 
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